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(54) User interface for text to speech conversion 

(57) An electronic device (2) Is disclosed which 
comprises aspeech synthesizer (6; 16) including a loud- 
speaker (6), arranged to convert an input dependent up- 
on punctuated text, to an audio output representative of 
a human vocally reproducing the text. It also comprises 
a user input device (4) for inputting instructions to nav- 



igate through text, between positions defined by punc- 
tuation identifiers of the text, to a desired position, and 
a controller (14) arranged to control navigation to the 
desired position and provide the speech synthesizer 
with an Input con-esponding to a portion of the text from 
the desired position, in response to input navigation In- 
structions. 
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Description 

[0001] The present invention relates to user Interface 
for a device which provides text to speech synthesis. 
[0002] The synthesis of human speech using elec- 
tronic devices is a well developed and published tech- 
nology and various commercial products are available. 
Typically speech synthesis programs convert written in- 
put to spolcen output by automatically generating syn- 
thetic speech and speech synthesis is therefore often 
refen-ed to as "text-to-speech" conversion (TTS). 
[0003] There are several problems in speech synthe- 
sis which, as yet, have not been satisfactorily resolved. 
One problem Is the difficulty in comprehension of the 
synthetic speech by a user. This problem may be exac- 
erbated in mobile electronic devices such as mobile tel- 
ephones or pagers which may have limited processing 
resources. 

[0004] It would be desirable to improve the level of 
comprehension a user has of the speech output from 
such speech synthesiser systems. 
[0005] According to one aspect of the present inven- 
tion, there is provided an electronic device comprising 
a speech synthesizer including a loudspeal<er, arranged 
to convert an input dependent upon punctuated text, to 
an audio output representative of a human vocally re- 
producing the text; a user Input device for inputting in- 
structions to navigate through text, between positions 
defined by punctuation Identifiers of the text, to a desired 
position; and a controller arranged to control navigation 
to the desired position and provide the speech synthe- 
sizer with an Input corresponding to a portion of the text 
from the desired position, in response to input naviga- 
tion Instructions. 

[0006] Such a device provides the user with a means 
for navigating through text thereby selecting desired 
portions to be output audibly by the speech synthesiser. 
Further, since the navigation is between punctuation 
identifiers, the portions of text are split logically, enabling 
the user to put Individual words into context more easily. 
Thus, the intelligibility of the audio output by the user is 
improved. 

[0007] The punctuation identifiers may be punctua- 
tion marks provided in the text, and/or other mariners. 
The electronic device may use punctuation identifiers 
which Identify the beginning of sentences, such as a full- 
stop (period), exclamation mark, question mark, capital 
letter, consecutive spaces. Altematively, the punctua- 
tion identifiers may be marks such as a comma, colon, 
semi-colon, or dash whteh are also used to separate 
words in text into logical units. Also, the input text can 
include special characters for this purpose. The creator 
of the text may, for example, use special characters to 
mari< words which may be difficult and thus need to be 
replayed, when he foresees intelllgibirity problems. 
[0008] The electronic device may comprise a display 
for presenting a text portion which the user can refer to 
confimn his understanding of the audio output. 



[0009] The device may be arranged to navigate back- 
wards through the text, thereby providing a function for 
repeating a portion of text. The device may respond to 
a repeat or backwards command input by a user, by the 

5 controller navigating backwards to a position defined by 
a predetemnined punctuation Identifier so as to repeat 
the portion of text from that position. 
[0010] The predetemnined punctuation identifier may 
be the first punctuation identifier in the backwards se- 

10 quence or altematively a second or further punctuation 
Identifier in the backwards sequence. However, prefer- 
ably the navigation depends on how quickly the repeat 
command is made after the audio output corresponding 
to the first punctuation identifier In the backwards se- 

15 quence. According to such an embodiment, the device 
may determine this based on the length of text and/or 
the length of time for audible reproduction of the text 
between the cun-ent position and the position defined by 
the first punctuation identifier in the backwards se- 

20 quence. If the length is below a threshold (such as five 
words, for example, or two seconds), the controller is 
arranged to navigate backwards to a position defined by 
the second punctuation identifier in the backward se- 
quence. 

25 [0011] The speech synthesiser may repeat the text 
more slowly than a default speed. This has the advan- 
tage of further improving the comprehensibility of the re- 
peated syntheslsed speech. If the device comprises a 
display, the default speed may be that of the display of 

30 text on the display. Altematively, the default speed may 
be the nomial speed of the output by the speech syn- 
thesiser. 

[0012] Alternatively, or in addition to the backward 
navigation, the device may be arranged to navigate f or- 

35 wards through the text. In this way, it can jump fonvards 
past a portion of the text. The device responds to a for- 
ward or skip command input by a user, by the controller 
navigating fonvards to a position defined by a predeter- 
mined punctuation identifier, so as to skip the portion of 

40 text between the cun'ent position and that position. In 
other words, It jumps to provide an audio output from 
the position defined by that predetemnined punctuation 
identifier, 

[001 3] The predetemnined punctuation identifier may 
45 be the first punctuation identifier in the forward se- 
quence, or altematively a second, or a further, punctu- 
ation identifier in thefonward sequence. However, pref- 
erably the navigation depends on how soon the audio 
output con-esponding to the next punctuation identifier 
50 would occur in the absence of the skip command. Ac- 
cording to such an embodiment, the device may deter- 
mine this based on the length of text and/or the length 
of time for audible reproduction of the text between the 
cun-ent position and the position defined by the first 
55 punctuation identifier in the forward sequence. If the 
length is below a threshold, the controller Is arranged to 
navigate fonvards to a position defined by a second 
punctuation Identifier in the forward sequence. 
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[0014] There are a number of ways in which a user 
can input his instmctlons. In one embodiment, the user 
may input Instructions via a user input comprising a key 
means. The key means may be a user actuable device 
such as a l<ey, a touch screen of the display, a joysticic 5 
or the like. The key means may comprise a dedicated 
instruction device. If the device provides for forward and 
backward navigation, then it may comprise separate 
dedicated navigation instruction devices. That is, one for 
forward navigation, and one for backward navigation. io 
[001 5] The control means may determine the number 
of device actuations and determine the position of the 
punctuation identifier associated with that number of ac- 
tuations. For example, pressing the dedicated key as- 
sociated with backward navigation instruction two times is 
could cause the device to navigate to a position of the 
punctuation identifier two back. 
[0016] Alternatively, the position of punctuation iden- 
tifier may be detemnined on the length of time the dedi- 
cated key is depressed. 20 
[0017] Alternatively, the key means may comprise a 
multi-function key. One function of this key is selecting 
a navigation instruction. The navigation instruction itself 
may be provided by the user inputting It, or via a menu 
option. In either case, the multi-function key is used to 
select the navigation instruction. 
[001 8] I nstead of, or in addition to the key means, the 
user input device may comprise a voice recognition de- 
vice. Such a vobe recognition device typically provides 
navigation instructions by way of a voice command. 30 
[0019] The electronic device may be a document 
reader, a portable communications device, a handheld 
communications device, or the like. 
[0020] According to another aspect of the present in- 
vention there is provided a portable radio communica- 35 
tions device comprising a speech synthesizer including 
a loudspeaker, arranged to convert an input dependent 
upon punctuated text, to an audio output representative 
of a human vocally reproducing the text; a user Input 
device for inputting instructions to navigate through text, <o 
between positions defined by punctuation identifiers of 
the text, to a desired position; and 
a controller arranged to control navigation to the desired 
position and provide the speech synthesizer with an in- 
put con-esponding to a portion of the text from the de- ^5 
sired position, in response to input navigation instruc- 
tions. 

[0021] The device may further comprise means for 

mounting in a vehicle. 

[0022] According to a further aspect of the invention, so 
there is provided a document reader comprising a 
speech synthesizer including a loudspeaker, arranged 
to convert an input dependent upon punctuated text, to 
an audio output representative of a human vocally re- 
producing the text; a user input device for inputting in- S5 
structions to navigate through text, between positions 
defined by punctuation identifiers of the text, to a desired 
position; and a controller an'anged to control navigation 



to the desired position and provide the speech synthe- 
sizer with an input corresponding to a portion of the text 
from the desired position, in response to input naviga- 
tion instnjctions. 

[0023] These devices may be provided in a car. If so, 
and if the device comprises key means, these are pref- 
erably provided on the steering wheel of the car. 
[0024] According to yet another aspect of the present 
Invention there is provided a method of navigating 
through text to a desired position for audio output by a 
speech synthesizer, the method comprising detecting 
instructions Input by a user to navigate through text, be- 
tween positions defined by punctuation identifiers of the 
text, to a desired position; controlling navigation to the 
desired position; and providing the speech synthesizer 
with an input con-esponding to a portion of the text from 
the desired position. 

[0025] According to a still further aspect of the present 
invention there is provided a method for providing 
speech synthesis of a desired portion of text, the method 
comprising detemnlning a desired start position from a 
selection defined by punctuation identifiers, from an in- 
struction input by a user; moving to the desired start po- 
sition; outputting speech synthesized text from that po- 
sition. 

[0026] Embodiments of the present Invention will now 
be described by way of example with reference to the 
accompanying drawings, of which:- 

Figure 1 illustrates an electronic device with a user 
interface having an input device and loudspeaker; 

Figure 2 is a schematic illustration of the compo- 
nents of the electronic device illustrated in Figure 1 ; 

Figure 3 Is a mobile phone according to an embod- 
iment of the present Invention; 

Figure 4 is a schematic illustration of the compo- 
nents of the mobile phone illustrated in Figure 3; 

Figures 5a and 5b illustrate the selection of naviga- 
tion commands according to an embodiment of the 
present invention; 

Figure 6 illustrates the navigation through text and 
the subsequent output of selective portions of the 
text; 

Figure 7 illustrates various methods of Inputting a 
repeat command; 

Figure 8 illustrates a method of repeating text ac- 
cording to a preferred embodiment of the invention; 
and 

Figures 9a and 9b illustrate exemplary databases 
for controlling navigation. 
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[0027] Figure 1 illustrates an electronic device 2. The 
electronic device has an Input device 4 and an output 
device 6. The Input device comprises a microphone 3 
for receiving an audio Input and a tactile input device 5. 
The output 6 Is a loudspeaker 6 which Is used to broad- 
cast synthesised speech to a user. 
[0028] The Input device may receive instructions from 
the user controlling selection of the synthesised speech 
to be output by the loudspeaker 6. This may be per- 
formed either by way of a tactile input and/or a voice 
command. For example, the user who did not hear a 
portion of the speech output by the loudspeaker 6 can 
Instruct the device 2 to replay that portion, thereby im- 
proving the user's comprehension. The tactile Input de- 
vice 5 may also be used to input text which may be 
broadcast by the loudspeaker 6 as synthesised speech. 
[0029] The electronic device may be any device which 
requires an audio Interface. It may be a computer (e.g. 
personal computer PC), personal digital assistant 
(PDA), a radio communications device such as a mobile 
radio telephone e.g. a car phone or handheld phone, a 
computer system, a document reader such as a web 
browser, a text TV, a fax, a document browser for read- 
ing books, e-mails or other documents of the like. 
[0030] Although the input device 4 and loudspeaker 
6 in Figure 1 are shown as being Integrated in a single 
unit they may be separate, as may be microphone 3 and 
text input device 5 of the input device 4. 
[0031] Figure 2 is a schematic illustration of the elec- 
tronte device 2. The device 2, in addition to having the 
Input device 4 and the loudspeaker 6 has a processor 
12 whfeh Is responsive to user Input commands 26 for 
driving the loudspeaker and for accessing a memory 10. 
The memory 1 0 stores text data 24 supplied via an Input 
4. The processor 12 is illustrated as two functional 
blocks - a controller 1 4 and a text-to-speech engine 16. 
The controller 14 and text-to-speech engine 16 may be 
implemented as software running on the processor 12. 
[0032] The text-to-speech engine 1 6 drives the loud- 
speaker 6. It receives the text input 1 8 from the controller 
and converts the text input to a synthetic speech output 
22 which Is transduced by the loudspeaker 6 to sound- 
waves. The speech output nnay, for example, be a cer- 
tain number of words at a time, one phrase at a time or 
one sentence at a time. 

[0033] The controller 14 reads the memory 10 and 
controls the text-to-speech engine 16. The controller 
having read text data from the memory provides it as an 
input 1 8 to the text-to-speech engine 1 7. 
[0034] The memory 1 0 stores text data whteh is read 
by the controller 14. The controller 1 4 uses the text data 
to produce the input 1 8 to the text-to-speech engine 1 7. 
Text data is stored in the memory 1 0 by the input device 
30. The input device In this example includes a micro- 
phone 3, a key means 5 (such as a key, display touch 
screen, joystck etc.) or a radio transceiver for receiving 
text data in the form of SMS messages or e-mails. 
[0035] The controller 14 also navigates through the 



text data in response to instructions 26 received from 
the user via input 4, so that the loudspeaker outputs the 
desired speech. Navigation may, for example, be for- 
warded to skip text or backwards to replay text. The nav- 
5 igation is perfomned so that the text is broadcast by the 
loudspeaker 1 6 in logical units. This is achieved by the 
controller parsing text It accesses from the memory 1 0. 
Parsing Involves using punctuation Identifiers within the 
text to separate portions of the text into logical units. Ex- 
10 amples of punctuation identifiers are those which Indi- 
cate an end of sentence such as a full stop (period) ex- 
clamation mark, question mark, capital letter, consecu- 
tive spaces, comma and other identifiers which indicate 
a logical break within the sentence, such as the comma, 
15 colon, semi-colon or dash. Alternatively, it may Involve 
a punctuation identifier which indicates an end of a 
group of a predetemnined number of words. The portion 
of the text between identifiers sent one at a time to the 
TTS engine 16. The controller maintains the database 
20 to enable control of the navigation. Examples are shown 
in Figures 9a and b of the accompanying drawings. 
[0036] In Figure 9a the controller parses the text Into 
groups of five words. This is useful, for example, where 
the text contains minimal or no punctuation marks. In 
25 this case, the controller groups the words by recognising 
space characters within the text and counting them. This 
may, for example, be done by looking for ASCII for a 
space character The database has an entry for each of 
the 18 words in the phrase. Each entry has two fields. 
30 The first field 91 records the count of spaces increment- 
ing from one to five. The second field 92 records which 
text group the word entry belongs to, based on the count 
in the first field 91, both storing a text group Identifier 
which is different for each group of five words. Referring 
35 to Figure 9a, there are four distinct text groups having 
group Identifiers 1 , 2, 3 and 4. Group 1 includes the 
words "Hello Fred, thank you for". Group 2 includes the 
words "your mail I look forward". Group 3 includes the 
words "to see you at two". Group 4 includes the words 
40 "o'clock on Thursday". 

[0037] In operation the controller 1 4 forwards group 1 
to the TTS 18, next group 2, then group 3 and finally 
group 4. During this time the controller 14 keeps track 
of which group is successfully output as synthesised 
45 speech. It may do this by storing the number of the group 
Identifier forwarded to the TTS 18. If the controller re- 
ceives the user's Instruction, then the controller navi- 
gates through the text to a desired position and forwards 
the associated text group to the TTS engine 1 6. For ex- 
50 ample, if the TTS engine is outputting synthesised 
speech corresponding to group 3, and the user inputs 
the backwards instruction, then control signal 26 causes 
the controller to navigate back through the text to the 
beginning of the last ID group to be output (or forwarded 
55 to the TTS), and re-sends that group to the TTS engine 
1 6 for conversion and output by the loudspeaker 6. For 
example, assuming group 3 is currently being output, 
then In response to a backwards control signal 26 from 



4 



7 



EP1 113416A2 



8 



the input 4, the controller 1 8 navigates back through the 
text to the beginning of group 3, to the word 1o", and 
forwards text group 3 to the TTS engine 16 again for 
output by the loudspeal^er 6 as synthesised speech. As- 
suming no further instructions are received from the us- 
er, then the controller 14 duly forwards the text group 4 
to the TTS engine, once the group 3 text is output. The 
controller 1 4 may be an^anged to move bacic two groups 
in response to a backward command. This may occur, 
for example, if an instniction is received when the be- 
ginning of a text group is being output, for example if the 
first and second words of a group are being output. So 
if the word "seeing" In group 3, for example, is being 
output when the controller receives the backward in- 
struction 26, then the controller may navigate back to 
the beginning of group 2 and forward that group to the 
TTS for output. 

[0038] Alternatively, the text replayed may be deter- 
mined by duration since the last group is sent to the TTS 
engine before receipt of the backward instruction, or by 
a specific user input, such as two signals being received 
within a predetermined period. These alternatives will 
be explained further below. 

[0039] Likewise, If a forward instmction Is received, 
the controller 1 4 navigates through the text and forwards 
the next group to the TTS engine for speech output by 
the loudspeaker 6. For example, if group 2 is currently 
being output as synthesised speech and the user inputs 
a foHA/ard Instruction, then control signal 26 causes the 
controller to navigate forward through the text to the be- 
ginning of the next group to be output, namely group 3 
and sends that group to the TTS engine for conversion 
to synthesised speech for output by the loudspeaker 
Thereby, the rest of the group 2 text not already output 
by the loudspeaker is skipped. Alternatively, if the end 
of group 2 Is being output (for example the words "look" 
or "fonvard") when a forward instruction is received, 
then the controller may skip the third group and forward 
the fourth group to the TTS engine for conversion to 
speech for output by the loudspeaker 6. 
[0040] Figure 3 Illustrates a radio handset according 
to an embodiment of the present invention. The hand- 
set, which is generally designated 30, comprises the us- 
er interface having a keypad 32, a display 33, a power 
key 34, a speaker 35, and a microphone 36. The hand- 
set 30 according to this embodiment Is adapted for com- 
munication via a wireless telecommunication network, 
e.g. a cellular network. However, a handset could alter- 
natively be designed for a cordless network. The keypad 
32 has a first group of keys 37 which are alphanumeric 
keys and by means of which the user can input data. 
For example, the user can enter a telephone number, 
write a text message (e.g. SMS), write a name (associ- 
ated with a phone number), etc, using these keys 37. 
Each of the 12 alphanumeric keys 37 is provided with a 
figure "0" to "9" or"#" or"*", respectively. In alpha mode, 
each key is associated with one or more letters and spe- 
cial signs used in text editing. The keypad 32 addition- 



ally comprises two soft keys 38a and 38b, two call han- 
dling keys 39, and a scroll key 31 . 
[0041] The two soft keys 8 have functionality corre- 
sponding to what is known from a number of handsets, 

5 such as the Nokia 21 10^^, Nokia 61 10^^ and Nokia 
811 0^^. The functionality of the soft key depends on the 
state of the handset and the navigation in the menu by 
using the scroll key, for example. The present function- 
ality of the soft key 38a and 38b is shown in separate 

10 fields in the display 33 just above the keys 38. 

[0042] The two call handling keys 39 may used for es- 
tablishing a call or a conference call, temiinating a call 
or rejecting an incoming call. 
[0043] The scroll key 31 in this embodiment is a key 

IS for scrolling up and down the menu. However other keys 
may be used Instead of this scroll key and / or the soft 
keys, such as a roller device or the like. 
[0044] Figure 4 is a block diagram of part of the hand- 
set of figure 3 which facilitates understanding of the 

20 present invention. As is conventional in a radio handset, 
it comprises speech circuitry in thefonn of user Interface 
devices (microphone 36 and speaker 35), an audio part 
44, transceiver 49, and a controller 48. The microphone 
36 converts speech audio signals into corresponding 

25 analogue signals which in turn are converted from ana- 
logue to digital by an AID converter (not shown). The 
audio part 44 then encodes the signal and, under control 
of the controller 48, forwards the encoded signal to the 
transceiver 49 for output to the communication network. 

30 [0045] In the reverse situation, an encoded speech 
signal which is received by a transceiver 49 is decoded 
by the audio part again under control of the controller 
48. This time the decoded digital signal is converted into 
an analogue one by a D/A converter (not shown), and 

35 output by speaker 35. 

[0046] The controller 48 also forms an interface with 
peripheral units, such as memory 47 having a RAM 
memory 47a and a flash ROM memory 47b, a SIM card 
46, a display 33 and a keypad 32 (as well as data, power 

40 supply, etc). 

[0047] In this embodiment, the audio part 44 also 
comprises a TTS engine which, together with the con- 
troller 48, fonn a processor, as in the figure 1 embodi- 
ment. The device 30 handles text speech synthesis In 

45 much the same way as described in connection with the 
con-esponding parts in figure 2. 
[0048] Text may be input by the user via the keyboard 
32 and / or microphone 36 or by way of receipt from the 
communications networi< by the transceiver 49. The text 

50 data received Is stored in memory (RAM 47a). The con- 
troller reads the memory and controls the TTS engine 
accordingly. The controller also navigates through the 
text In response to instructions received from the user 
via one or more of the microphone 36, keyboard 32 and 

55 navigation and selection keys 45, so that the speaker 
35 outputs the desired speech In logical units. 
[0049] In this embodiment, as well as outputting text 
or speech, the handset also presents text on the display 



5 



9 



EP 1113 416 A2 



10 



33. Consequently the processor is responsible for con- 
trolling the display driver to drive the display to present 
the appropriate text. When it reads the memory 47a and 
controls the TTS engine, the controller 14 also controls 
the display. Having read text data from the memory, in 
this embodiment, the controller provides it as an input 
to the TTS engine and controls the display driver to dis- 
play the text data used in control signals 431 . The dis- 
played text corresponds to the text converted by the TTS 
engine. This is also the case when a navigation instruc- 
tion is received from the user. The database used for 
controlling navigation is used for the purpose of text out- 
put in general, and when the display text is desired the 
database is used In the control of the display simultane- 
ously with the control of the TTS engine. In other words, 
In the figure 9a database, for example, when the con- 
troller sends a text group to the TTS engine, that text 
group is also sent to the display driver for presentation 
on the display. 

[0050] A handset such as that in figure 3 would gen- 
erally have a range of menu functions. The Nokia 611 0, 
for example, can have the following menu functions: 

1 . Messages 

2. Call Register 

3. Profiles 

4. Settings 

5. Call divert 

6. Games 

7. Calculator 

8. Calendar. 

[0051] To access the menus, the user can scroll 
through the functions using the navigation and selection 
key 45 or using appropriate pre-defined short cuts. In 
general, the left hand scroll key 38a will enable the user 
to navigate through sub menus and select options, 
whereas the right hand soft key 38b will enable the user 
to go back up the menu hierarchy. The scroll key 31 can 
be used to navigate through the options list in a partic- 
ular menu/sub-menu prior to selection using the left 
hand scroll key 38a. 

[0052] The messages menu may include functions re- 
lating to text messages (such as SMS), voice messag- 
es, fax and data calls, as well as servtee commands from 
the networks information servtee messages. A typical 
function list may be: 

1-1 Inbox 

1-2 Outbox 

1-3 Write Messages 

1-4 Message Settings 

1-5 Info Service 

1-6 Fax or Data Call 

1-7 Service Command Editor. 

[0053] In the present Invention, the handset has a set- 
ting for text speech synthesis. This setting may be pre- 



defined or be a profile to be selected by the user. If the 
setting is "On", then the Inbox message function may 
comprise options for the user to listen to a received text 
message etc. Figure 5a illustrates how a user may se- 
5 lect a message stored in the message inbox and listen 
to it, whilst figure 5b illustrates how to navigate through 
the message. 

[0054] In this embodiment, the menu options are dis- 
played one at a time. The messages menu is the first 

10 option and is presented on the display (stage 501 ). The 
user can select this option by pressing the left scroll key 
38a associated with the "select" function displayed. Al- 
ternatively, if this option is not desired, the user can use 
the right hand scroll key to go back to the main menu, 

15 or the scroll key to scroll to an alternative option for se- 
lection, such as Call Settings. 
[0055] If the Messages option is selected, the first op- 
tion in the first sub-menu is displayed, namely Inbox 
(stage 502). If the user selects this option by pressing 

20 the left scroll key 38a, in this embodiment, the last three 
text messages are displayed, with the last received 
message being presented first in an options list (stage 
503). This last received message is the default option 
which Is selected if the left hand soft key 38a is pressed. 

25 This default option may be indicated by being highlight- 
ed on the display. If the user wishes to read one of the 
other messages, he can navigate to them using the 
scroll key. Once a message has been selected, the user 
Is given the choice of listening or reading the chosen 

30 message. (The listen option may be listen only or listen 
and read depending on the handset configuration). "Lis- 
ten" is the default option. This may be chosen by press- 
ing the left hand soft key 38a or the alpha key "1 ". Alter- 
natively, In a preferred embodiment, the listen option 

35 may be automatically selected in the absence of user 
input after a certain period, for example two seconds. In 
the embodiment of figure 5a, the handset is configured 
to play and display the selected message if the "Listen" 
option is selected (stage 505). 

40 [0056] A number of further options are available in re- 
spect of the selected message depending upon the 
state of the handset. 

[0057] If the listen option is selected as in stage 504, 
then during play of the message, the available options 

45 are fonvard and backward navigation options as de- 
scribed further with respect to figure 5b. Once the mes- 
sage has finished playing for a predetemiined period 
without further user input, the options change to con- 
ventional text message options such as erase, reply, ed- 

50 it, use number fonward, print via IR details etc. (stage 
506). 

[0058] If the read option is selected, then the same 
options are available irrespective of whether the whole 
message is presented on the display for the user to read. 
55 [0059] Turning nowto figure 5b, this illustrates receipt 
of an incoming message (rather than accessing one pre- 
viously received as in stage 503 of figure 5a). 
[0060] When a message is received from the commu- 



6 



11 



EP1 113 416 A2 



12 



nications network via the transceiver 49, the controller 
sends a control signal to the display driver for the display 
to present a menu option as shown in stage 507. If the 
user wishes to access a message whilst the handset is 
in this state, then the left soft key 38a Is pressed. De- 
pression of the right soft key, on the other hand, will exit 
this menu, and the stored messages can be viewed/lis- 
tened to later via the stages shown in figure 5a. 
[0061] In the figure 5b embodiment, when the left soft 
key is pressed the received message is accessed. The 
user is then given a choice to listen or read the message 
(stage 508). In this particular embodiment, the handset 
is configured to only play the message if the listen option 
is selected (by pressing the left soft key or the alpha 
numeric key "1"), and consequently the navigation op- 
tions available are presented on the display (stage 509). 
The navigation options available in this embodiment are 
backwards and forwards options, with the backward op- 
tion being the default. The backwards option may be se- 
lected by pressing the left soft key or the alphanumeric 
key "r, or alternatively automatically when there has 
been no user input for a predetermined period. The for- 
ward option, on the other hand, may be selected by 
scrolling down once using the scroll key and then se- 
lecting using the left hand soft key 38a, or more qutekly 
by pressing alphanumeric key "2". If either option is se- 
lected, in this embodiment, then a choice of backwards/ 
forwards steps is given (stage 510). 
[0082] In this case, jumps 1 , 2 or 3 are available, and 
the desired jump may be selected using the appropriate 
alphanumeric key or the left soft key, following the scroll 
key if appropriate. The jump by one position backwards 
or forwards Is the default, and may automatically select- 
ed if the user doesn't provide any input within a prede- 
temnined period. The numbers 1-3 represent the 
number of jumps between punctuation identifiers in the 
chosen direction, as for example is described above 
with reference to figures 9a and 9b. 
[0063] As mentioned above. In the figure 5b embodi- 
ment the listen option is listen only and hence once the 
listen option is selected (stage 508), the backwards and 
forwards options are presented on the display (stage 
509). In contrast, in the figure 5a embodiment, the listen 
option is listen and read (play and display) and hence 
once the listen option is selected, the message is dis- 
played on the display (stage 505). 
[0064] In the figure 5a situation when the user selects 
the "listen" option, "options" can be selected using the 
left soft key 38a to present navigation options on the 
display (as in stage 509 of the figure 5b embodiment). 
Likewise, a choice from these options can be made in 
the same way as for the navigation option of the figure 
5b embodiment (stage 509) and the number of steps, 1 , 
2 or 3, as In stage 510. 

[0065] Alternatively, when the message is being 
played, shortcut keys, alphanumeric keys 1 and 2, can 
be pressed to automatically select the desired naviga- 
tion option. Once a navigation option has been selected, 



the chok:e of number of backwards/forwards steps is 
presented to the user as in stage 510 of the figure 5b 
embodiment. 

[0066] Figure 6 illustrates navigation through the text 

5 and subsequent output of selective portions of the text. 
According to this embodiment, the controller 48 deter- 
mines whether the user has selected the message lis- 
tening option (step 601 ). If this is the case, the controller 
48 reads text data from the memory 47 and controls the 

10 TTS engine to play the stored message over the speak- 
er 35 (step 602). Whilst the message is being played, 
the controller checks for any input commands from the 
user (step 604). If no command is detected, then the 
controller continues to forward the message to the ITS 

IS engine until the end of the message is reached (step 
603) then playing is stopped. If, on the other hand, the 
controller detects the input of a command, it detemnines 
the type of command. In this embodiment, the controller 
firstly detects whether the command is a backwards 

20 command. If it is, the controller then determines the po- 
sition to move back to (step 606), moves to that position 
(step 607), and the TTS engine plays the message from 
that position (step 608). For example, the controller 
identifies a punctuation identifier, reads the message 

25 stored in memory from that identifier and forwards that 
part of the message to the input of the ITS engine for 
replay. 

[0067] If the command is not a backwards command, 
then the controller detemnines whether the command is 

30 afonwards command (step 609). If so, then the controller 
determines the position to move fon/vard to (step 610), 
moves to that position (step 607) and the TTS engine 
plays the message from that position (step 608). For ex- 
ample, the controller identifies the punctuation Identifier, 

35 jumps to the part of the message from that identifier in 
the memory and forwards it to the input of the TTS en- 
gine for speech output. 

[0068] Figure 7 illustrates various methods of input- 
ting a repeat command. The controller 48 determines 

40 whether the user has selected the message listening op- 
tion (step 701 ). If this is the case, the controller 48 reads 
the text data from the memory 47 and controls the TTS 
engine to play the stored message over the speaker 35 
(step 702). Whilst the message is being played, the con- 

45 troller checks whether a backwards Input command has 
been received from the user (step 704). If no command 
is detected then the controller continues to forward the 
message to the TTS until the end of the message is 
reached (step 703). Then playing is stopped. 

50 [0069] If, on the other hand, the controller detects a 
backwards input command, it goes on to determine the 
point from which the message is to be replayed. Four 
alternatives are illustrated in the flow chart of Figure 7. 
These are illustrated as a string of steps in this flow 

55 chart, but It will be appreciated that a handset may only 
Implement any one, or any combination, of them, 
[0070] Firstly, the controller determines whether a 
dedicated key is pressed (step 705). If so, it goes on to 
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determine how many key presses (N) the user has made 
(step 706) and determines the position of the N"' punc- 
tuation identifier back. For example, if the user presses 
the dedicated key twice, then the controller detenmines 
the position of the second punctuation identifier in the 
backwards direction from the current position. 
[0071] Secondly, the controller detects whether a 
function key corresponding to an input command is 
pressed. If so, it detemnines how many backward steps 
are selected (S) (step 711) and determines the position 
of the S**^ punctuation identifier back (step 71 2). For ex- 
ample, the controller may identify selection of certain 
number of steps (S) using the scroll key 31 and left soft 
key 38 as described with reference to stage 510 of Fig- 
ure 5(c) above. 

[00721 Thirdly, the controller may detemiine whether 
an alphanumeric key is pressed subsequent to a back- 
wards command input (step 720) and if so detemnines 
the digit (D) associated with the key press (step 721) 
and determines the position of the D* punctuation Iden- 
tifier back (step 722). 

[0073] For example, the controller may detect press- 
ing of the alpha numeric key "1" and detemiine the po- 
sition of the previous punctuation identifier on that basis . 
[0074] Fourthly, the controller may detennine whether 
a voice command is input (step 730), and if so the con- 
troller will detennine how many backward steps ( R) 
have been requested (731) and thus detemiine the po- 
sition of the punctuation identifier back. This can be 
achieved using conventional voice recognition technol- 
ogy' 

[0075] Once the desired position has been deter- 
mined, the controller moves back to that position (step 
708) and the TTS engine plays the message from that 
position (step 709). 

[0076] Figure 8 illustrates a method of repeating text 
according to a preferred embodiment of the present in- 
vention. 

[0077] The controller 48 detemnines whether the user 
has selected the message listening option (step 801). If 
this is the case, the controller 48 reads the text data from 
the memory 47 and controls the TTS engine to play the 
stored message (step 802). Whilst the message is being 
played, the controller checks for a backwards command 
from the user (step 804). If no command Is detected then 
the controller continues to fonward the message to the 
TTS until the end of the message is reached (step 603). 
Then playing is stopped. 

[0078] If, on the other hand, the controller detects a 
backwards command input it then goes on to detemnlne so 
whether a dedicated key is pressed (step 805). The con- 
troller is arranged to control playback from an earlier 
punctuation identifier if the first identifier back from the 
position at the time of the backward command is close 
to that position and the user inputs the further backward 55 
command within a certain time frame from the first com- 
mand. This is achieved by the controller comparing the 
period between the present position and the position of 



the previous punctuation identifier (step 805) in re- 
sponse to the detection of the pressing of the dedicated 
key (step 804), and then checking whether the key is 
pressed again within a certain period (e.g. two seconds 
5 from the previous key press) (step 809). If this is the 
case, then the controller moves to the position of the 
second punctuation identifier back from the current po- 
sition (step 810), Altematively, if either the period be- 
tween the present position and position of the previous 
10 punctuation identifier is not less than the threshold (step 
806) or the key is not pressed again within the prede- 
termined period from the first key press (step 810), the 
controller moves to the position of the previous punctu- 
ation identifier from the current position. In either case, 
15 the controller reads the message from the appropriate 
punctuation identifier from the memory and fonwards the 
message from that point to the input of the TTS engine 
for output (step 808). 

[0079] The present invention includes any novel fea- 
20 ture or combination of features disclosed herein either 
explicitly or any generalisation thereof in-espective of 
whether or not it relates to the claimed invention or mit- 
igates any or all of the problems addressed. 
[0080] In view of the foregoing description it will be 
25 evident to a person skilled in the art that various modi- 
fications may be made within the scope of the invention. 
For example, whilst the examples show a mobile com- 
munications environment, the Invention is equally appli- 
cable to other environments. In short, the invention 
30 would apply to any text-to-speech service. One such 
case, is the invention's application running on a Telco 
Service-server connected to a PSTN and accessed us- 
ing a phone such as a mobile phone. Speech synthesis 
could then be controlled using DTMF tones. 

35 

Claims 

1 . An electronic device comprising: 

40 

a speech synthesizer including a loudspeaker, 
an-anged to convert an input dependent upon 
punctuated text, to an audio output represent- 
ative of a human vocally reproducing the text; 

45 

a user input device for inputting instructions to 
navigate through text, between positions de- 
fined by punctuation identifiers of the text, to a 
desired position; and 

a controller arranged to control navigation to 
the desired position and provide the speech 
synthesizer with an input corresponding to a 
portion of the text from the desired position, in 
response to input navigation instructions. 

2. A device as claimed in claim 1 , further comprising 
a display for displaying text. 
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3. A device as claimed in claim 1 or 2, arranged to nav- 
igate backwards through the text. 

4. A device as claimed in claim 3, wherein the control- 
ler is arranged to navigate backwards to a position 
defined by a predetennined punctuation identifier in 
response to an input to the user input device. 

5. A device as claimed in claim 4, wherein the control- 
ler is arranged to navigate backwards to a position 
defined by the first punctuation identifier in the back- 
wards sequence. 

6. A device as claimed in claim 4, wherein the control- 
ler is arranged to navigate backwards to a position 
defined by the second punctuation identifier in the 
backwards sequence. 

7. A device as claimed in any of claims 4 to 6, further 
comprising means fordetemriiningthe length of text 
and/or length of time for audible reproduction of the 
text between the cun'ent position and the position 
defined by the first punctuation identifier in the back- 
wards sequence and, if the length is below a thresh- 
old, the controller is an^anged to navigate back- 
wards to a position defined by a second punctuation 
identifier in the backwards sequence. 

8. A device as claimed in any of claims 3 to 7, wherein 
the controller controls the speech synthesizer to 
provide an audio output of the text between the cur- 
rent position and the position defined by the prede- 
termined punctuation identifier at a slower speed 
than a default speed. 

9. A device as claimed in claim 8, when dependent up- 
on claim 2, wherein the default speed is that of the 
display of text on the display. 

10. A device as claimed in claim 8, wherein the default 
speed is the default speed of the audio output of 
text by the speech synchroniser. 

11 . A device as claimed in claim 1 or 2, arranged to nav- 
igate fonvards through the text. 

12. A device as claimed in claim 11 , wherein the con- 
troller is arranged to navigate fonvards to a position 
defined by a predetennined punctuation Identifier in 
response to an input to the user input device. 

13. A devk:e as claimed in claim 12, wherein the con- 
troller is arranged to navigate fonvards to a position 
defined by the first punctuation identifier in the for- 
wards sequence. 

14. A device as claimed in claim 12, wherein the con- 
troller is arranged to navigate forwards to a position 



defined by the second punctuation identifier in the 
forwards sequence. 

1 5. A device as claimed in any of claims 1 2 to 1 4. further 
5 comprising means for detennining the length of text 

and/or length of time for audible reproduction of the 
text between the current position and the position 
defined by the first punctuation identifier in the for- 
wards sequence and, if the length is below a thresh- 
10 old, the controller is arranged to navigate fonwards 
to a position defined by a second punctuation iden- 
tifier in the forwards sequence. 

16. A device as claimed in any preceding claim, ar- 
'5 ranged to navigate forwards through the text in re- 
sponse to a first instruction and backwards through 
the text in response to a second instruction. 

17. A device as claimed in any preceding claim, where- 
to in the user input device comprises a key means. 

18. A device as claimed in claim 17, wherein the key 
means is a dedicated navigation instruction key. 

2s 1 9. A device as claimed In claim 1 8, wherein the control 
means is arranged to detemriine the number of key 
actuations, and determine the position of the punc- 
tuation identifier associated with that number of key 
presses. 

30 

20. A device as claimed in claim 1 7, wherein the key 
means comprises a multifunction key, and the con- 
troller controls the functionality of the multifunction 
key. 

55 

21 . A device as claimed in claim 20, wherein one func- 
tion of the multifunction key Is selecting a navigation 
Instruction. 

40 22. A device as claimed in claim 21 , wherein the control 
means is arranged to detemnine the position of the 
punctuation identifier associated with the naviga- 
tion instruction selected by the multifunction key. 

45 23. A device as claimed in claim 21 or 22, arranged to 
provide the user with a navigation instruction op- 
tions menu and for the user to select from the menu 
using the multifunction key. 

so 24. A device as claimed in claim 21 or 22, arranged 
such that the user inputs the navigation instruction 
via the user Input device. 

25. A device as claimed in any preceding claim, where- 
55 in the user input devk;e comprises a voice recogni- 
tion device. 

26. A device as claimed in claim 21 or 22, an^anged 
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such that the user inputs the navigation instruction 
by way of a voice command. 

27. A device as claimed in any of claims 20 to 26, 
wherein the instruction is a number, and the control 
means is arranged to detemilne the position of the 
punctuation Identifier associated with that number. 

28. A device as claimed in any preceding claim, where- 
in the punctuation Identifiers are one or more se- 
lected from punctuation marks, capital letters, spac- 
es, a header of a group of words. 

29. A device as claimed in any preceding claim, where- 
in the electronic device Is a document reader or a 
portable and/or hand-held communications device. 

30. A portable radio communications device compris- 
ing: 

a speech synthesizer including a loudspeaker, 
arranged to convert an input dependent upon 
punctuated text, to an audio output represent- 
ative of a human vocally reproducing the text; 

a user input device for inputting instructions to 
navigate through text, between positions de- 
fined by punctuation Identifiers of the text, to a 
desired position; and 

a controller arranged to control navigation to 
the desired position and provide the speech 
synthesizer with an input corresponding to a 
portion of the text from the desired position, in 
response to input navigation instructions. 

31 . A device as claimed in claim 30, which is a hand- 
held device. 



response to input navigation instructions. 

34. A car having a device as claimed in any of claims 1 
to 32, or a document reader as claimed in claim 33. 

5 

35. A car as claimed In claim 34, wherein the user input 
device comprises key means on the steering wheel. 

36. A method of navigating through text to a desired po- 
10 sitlon for audio output by a speech synthesizer, the 

method comprising: 

detecting instructions input by a user to navi- 
gate through text, between positions defined by 
IS punctuation identifiers of the text, to a desired 

position; 

controlling navigation to the desired position; 
and 

providing the speech synthesizer with an input 
20 corresponding to a portion of the text from the 

desired position. 

37. A method for providing speech synthesis of a de- 
sired portion of text, the method comprising: 

25 

detemnining a desired start position from a se- 
lection defined by punctuation identifiers, from 
an Instruction input by a user; 
moving to the desired start position; 
30 outputting speech synthesized text from that 

position. 



35 



32. A device as claimed In claim 30 or 31 , comprising 40 
means for mounting in a vehicle. 



33. A document reader comprising: 



a speech synthesizer including a loudspeaker, « 
arranged to convert an input dependent upon 
punctuated text, to an audio output represent- 
ative of a human vocally reproducing the text; 

a user input device for inputting instructions to so 
navigate through text, between positions de- 
fined by punctuation identifiers of the text, to a 
desired position; and 



a controller arranged to control navigation to ss 
the desired position and provide the speech 
synthesizer with an Input con-esponding to a 
portion of the text from the desired position, In 
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